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Abstract 

The antique Mills Futurity slot machine has two unusual features. 
First, if a player loses 10 times in a row, the 10 lost coins are returned. 
Second, the payout distribution varies from coup to coup in a manner that 
is nonrandom and periodic with period 10. It follows that the machine 
is driven by a 100-state irreducible period-10 Markov chain. Here we 
evaluate the stationary distribution of the Markov chain, and this leads 
to a strong law of large numbers and a central limit theorem for the 
sequence of payouts. Following a suggestion of Pyke (2003), we address 
the question of whether there exists a two-armed version of this "one- 
armed bandit" that obeys Parrondo's paradox. More precisely, is there 
such a machine with the property that the casino can honestly advertise 
that both arms are fair, yet when players alternate arms in certain random 
or nonrandom ways, the casino makes money in the long run? The answer 
is a qualified yes. Although this "history-dependent" game is conceptually 
simpler than the original such games of Parrondo, Harmer, and Abbott 
(2000), it is nearly as complicated analytically, and open problems remain. 
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1 Introduction 



The Futurity slot machine, a 1936 design of Mills Novelty Company of Chicago, 
has two unusual features, one readily apparent and the other less so. The 
readily apparent feature is that, if the player loses 10 times in a row, the 10 
lost coins are returned. At the top of the machine is a pointer that indicates 
the number of consecutive losses incurred. It advances by 1 after each loss, and 
resets at after a win or after 10 consecutive losses. The less apparent feature 
is that there are 20 symbols on each of the three reels but only the ones in 
even-numbered positions can appear on the payline if the machine is in mode 
E, while only the ones in odd- numbered positions can appear on the payline 
if the machine is in mode O. The mode is nonrandom and is determined by a 
cam that rotates through 10 positions, advancing one position with each coup 
and resulting in a specific mode pattern of length 10, EEEEEOEEEO, which is 
repeated ad infinitum. (Note that we could substitute any cyclic permutation 
of this mode pattern, such as EEEOEEEEEO, without effect.) When in mode 
E, the machine is extremely "tight" (i.e., the mean payout from a one-coin bet 
is much less than 1). When in mode O, it is extremely "loose." 

There are several questions that might be asked. Does the sequence of 
payouts obey the strong law of large numbers and the central limit theorem, as 
it would for a traditional slot machine for which the sequence can be assumed 
independent and identically distributed? If so, what are the mean and variance 
parameters? What is the asymptotic probability of a nonzero payout? How 
frequently does the player lose 10 times in a row, thereby receiving the so- 
called Futurity award? Are there advantageous opportunities depending on the 
information available to the player about the state of the machine? 

Notice that the machine is driven by a Markov chain with state space S := 
{0, 1, . . . , 9} X {0, 1, . . . , 9} interpreted as follows. The machine is in state («, j) 
if the cam position is i and the pointer position is j. (If the cam position is 5 or 
9, the machine is in mode O; if the cam position is 0-4 or 6-8, the machine is in 
mode E.) If we kept track of the mode (E or O) instead of the cam position (0- 
9), we would lose the Markov property. There is also a pointer position 10, but 
from that position the pointer instantly moves to position 0, so we can ignore 
pointer position 10. By evaluating the stationary distribution of this Markov 
chain, we can infer the long-term behavior of the slot machine. Specifically, we 
can establish a strong law of large numbers and a central limit theorem for the 
sequence of payouts. 

The Futurity came to our attention via articles of Geddes (1980) and Geddes 
and Saul (1980) that appeared in Loose Change, a magazine for collectors of 
antique slot machines (published 1977-1998 and archived at the UNLV Lied 
Library). Geddes and Saul used Monte Carlo simulation to study the Futurity, 
claiming that an analytical solution "falls somewhere between formidable and 
monumental on a relative scale of mathematical difficulty." As we will see, the 
claim is untrue. 

Parrondo's paradox can be regarded as the observation that there exist two 
fair games that can be combined, either by random mixture or nonrandom 
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alternation, to create an unfair game. See the survey articles by Harmer and 
Abbott (2002), Parrondo and Dinfs (2004), Epstein (2007), and Abbott (2009). 
To motivate his discussion of the paradox, Pykc (2003) raised the following 
question without providing an explicit answer. 

You are about to play a two-armed slot machine. The casino that 
owns this two-armed bandit advertises that both arms on their two- 
armed machines are "fair" in the sense that any player who plays 
either of the arms is assured that the average cost per play ap- 
proaches zero as the number of plays increases. However, the casino 
does not constrain you to stay with one arm; you are allowed to 
use either arm on every play. [ . . . ] The question of interest in this 
context would be whether it is possible for the casino to still make 
money using only "fair" games. 

Our aim here is to formulate a two-armed version of the Mills Futurity 
that answers Fyke's question affirmatively. The feature of the Futurity that 
permits Parrondian behavior is the Futurity award (the return of the 10 lost 
coins after 10 consecutive losses); the periodicity of the payout distribution is 
not important. This "history-dependent" bonus feature makes our hypothetical 
two-armed slot machine not unlike the history-dependent games introduced by 
Parrondo, Harmer, and Abbott (2000). In fact, it has some advantages over the 
original such games: It is conceptually simpler and less contrived. On the other 
hand, it is nearly as complicated analytically. 

Actually, our answer to Fyke's question must be qualified. It is an un- 
qualified yes for the random- mixture strategies. It is a qualified yes for the 
nonrandom-alternation strategies because certain assumptions are needed and 
our conclusions rely on an unproved conjecture. And the answer is simply no 
if the player's strategy is completely unrestricted because there exist strategies 
that actually give the player an advantage. In particular, our two-armed version 
of the Futurity is not ready for casino play. 

We should clarify how it works. The player can pull cither arm at each coup. 
After 10 consecutive losses, regardless of the order of play of the two arms, the 
10 lost coins are returned to the player. On the other hand, each arm has its 
own cam mechanism, each with 10 positions, hence its own periodic pattern 
of payout distributions (though the payout distribution need not vary). The 
cam position for an arm advances only when that arm is pulled. Indeed, if this 
were not the case and both cam position advanced when either arm was pulled, 
astute players would simply pull the arm with the higher mean payout, and the 
casino would be beaten at its own game. Of course, there is nothing special 
about the number 10 in this context, so we replace it throughout by the integer 
J > 2. 

The question of whether Farrondo's paradox can appear in the casino setting 
was raised by Harmer and Abbott (2002, Section 2.3.3). Our example shows 
that the potential exists, even though it will not likely be realized. However, 
in our case the winning game created from two fair games is winning for the 
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casino, not for the player. If it were the other way around, the casino would 
likely discontinue the game or change the rules. 

In a previous paper (Ethier and Lee 2009) the authors formulated a general 
version of Parrondo's games. The results of that paper do not immediately 
apply here because the present underlying irreducible Markov chain is periodic. 
Even if that issue could be overcome, the Markov chain here is rather com- 
plicated relative to the three- and four-state chains that were studied in the 
previous paper. It is therefore preferable to use a different approach here that 
avoids having to evaluate the fundamental matrix and spectral representation 
associated with the one-step transition matrix of the Markov chain. 

2 The Markov chain at equiUbrium 

We will analyze a generalized (one-armed) version of the Futurity, dependent 
on several parameters. In Section 5 we will substitute the actual numbers. 

We assume that the cam controlling the payout distribution has / positions, 
denoted by 0, 1, ...,/— 1. When in cam position i, the probability of a nonzero 
payout is pi, the mean payout is fii, and the variance of the payout is af; none 
of these parameters takes the Futurity award into account. As for the Futurity 
award, we assume that, if the player loses J times in a row, the J lost coins are 
returned. A pointer that indicates the number of consecutive losses advances 
by 1 after each loss, and resets at after a win or after J consecutive losses. 

If we were interested solely in the Futurity, we would take I = J and simplify 
matters considerably. However, in studying Parrondo's paradox for a two-armed 
version of the Futurity, it will be necessary to allow / in the generalized one- 
armed machine to be an integer multiple of J, say / = dJ for a positive integer 
d. Of course, the case d = 1 is included and is in fact of primary interest. 

The Markov chain {{X„,Yn)}n>o that drives (or controls) the generalized 
(one-armed) Futurity has state space E := {0, 1, . . . , / — 1} x {0, 1, . . . , J — 1}. 
It is in state (i,j) at time n if the cam position is i and the pointer position is 
j following the nth coup. The transition probabilities have a very simple form: 



where < < 1 and qi := 1 — pi for i = 0, 1, . . . , / — 1. We notice that the 
one-step transition matrix P is irreducible and periodic with period /. 

Theorem 1. The unique stationary distribution tt for the Markov chain in S 
with one-step transition matrix P is given recursively by 



p{{i,j),{k,i)) :=p((x„+i,r„+i) = (fc,o I (x„,y„) = 




n{i,0) 



Pt-1 + qi-1 ■ ■ ■ qi-.jpi-.j-i H h ■ ■ ■ qt-(d-i).]Pi~{d-i).]-i 

i{i-Q) 



(1) 
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for i = 0,1,..., I -1, 

n{i,l)=cu^nT{t-l,0), i = 0,l,...,I-l, (2) 
7r(i,2) =f/,_i^(i-l,l), i^O,l,...,I-l, (3) 

TT{i,J-l)=cu^nT{i-l,J-2), i = 0,l,...,/-l, (4) 

where Q := qaqi ■ ■ ■ qi^i, p-i := pi^i and q^i := qj^j for i ~ 1,2,...,/, and 
7r(— 1, j) 7r(/ — 1, j) for j = 0, 1, . . . , J — 1. Furthermore, 

7r(i,0) + 7r(i,l) + --- + 7r(i, J-1) = J, i = 0, 1, ...,/- 1. (5) 

Remark. In the special case I ^ J (i.e., d = 1), ([T]) and jl]) simplify to 

"(^''^)=j(T3g)' ^ - = ^-7(130) • 

Proof. The stationary distribution is the unique probability (row) vector tt sat- 
isfying 

TT = TVP. (6) 

Equations ©-([I]) are immediate from this. This reduces the problem to a 
system of / linear equations in / variables, 7r(i,0), i = 0, 1, ...,/— 1. The 
system is a rather complicated one, so we take a different approach, noticing 
that these probabilities can be obtained probabilistically. 

If the Markov chain has the stationary distribution as its initial distribution, 
it is a stationary process, and we can extend its time parameter to the set of 
all integers. Intuitively, we can assume that the machine has been operating 
forever. What is the probability that, at a particular time, the Markov chain 
is in state (i,0)? First the cam position must be i, the probability of which 
is 1//. Second, either the last coup resulted in a win (conditional probability 
Pi-i) or the last coup completed a string of J or 2 J or 3 J or ... consecutive 
losses, causing the pointer to reset at and the Futurity award to be paid. 
Thus, the conditional probability that the pointer position is 0, given that the 
cam position is i, is 

Pi-l + Qt-l ■ ■ ■ Qi-JPi-J-l + Qi-l ■ ■ ■ qi-2JPi-2J-l 

H 1- qi-i ■ ■ ■ qi-djPi-dj-1 + qi-i ■ ■ ■ qi-(d+i)jPi-(d+i)j-i H — 

= p,_i(i + g + q2 + • • • ) + • • • q,-jp,-.j-i{i + Q + + • • • ) 

H h q,-i ■ ■ ■ q,^(d~i).jPi-(d-i)j-i{^ + Q + H ) 

= (pi-i + qi-i ■ ■ ■ qt-jPt-j^i 

H h qt-i ■ ■ ■ (7,-(d-i),/ft-(d-i),/-i)/(l - Q), 

where Pi-mi Pi for all i G {0, 1, . . . , / — 1} and m > 1, and similarly for 
complementary probabilities qi-mi- This implies ([T]). 
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This argument is a bit heuristic (since we essentiahy assumed (O , one of the 
conclusions of the theorem), but now we can make it rigorous. First, we verify 
that 77, given by is a probabihty vector by proving (O. Using ©-(H]) 

and then ([1]), the left side of (O is equal to 

7r(i, 0) + q.,_i7r(i -1,0)+ q^-lq^-2Hi - 2, 0) 

H 1- Qi-l ■ ■ ■ qi-J+lT^{i - J + 1, 0) 

= [Pi-i + Qi~i ■ ■ ■ qi~.JPz~.J~i H h qi~i ■ ■ ■ qi~{d~i).jPi-{d-i)j~i 

+ qi-i{pi-2 + qi-2 ■ ■ ■ qi-.j-iPi-.j~2 

+ • • • + qi-2 ■ ■ ■ q,~{d~i)j~iPi~{d~i)j~2) 

H h qi-i ■ ■ ■ qj_j+i(pj_,7 + • • • qi-2J+lPi~2J 

H K qt~j ■ ■ ■ qi~dj+iPi~d.i)]/[i{'^ - Q)] 

_ Pi~i + qi~iPi~2 + qi~iqi~2Pi~3 H 1- ■ ■ ■ qi~dj+iPi~dj 

_ 1 - ■ --qi-dj _ l_ 

I{l-Q) 

where the second equality amounts to a rearrangement of terms, and the third 
equality is an algebraic identity. 

Next, for ([6]) it will suffice to show, for z = 0, 1, ...,/— 1, that 

7r(i,0) =p,_i[7r(i - 1,0) + •• •7r(i - 1, J - 2)] +7r(i - 1, J - 1). 

This can be rewritten, using ^ and ©^Q, as 

7r(z, 0) = Pz-i[K{i - 1, 0) + • • • 7r(z - 1, J - 1)] + g,_i7r(i - 1, J - 1) 

= + qt-i ■ ■ ■ qi-jTr{i - J, 0). 

Fix i and substitute ([T]). It is enough that 

Pi-i + qi-i ■ ■ ■ qi-jPi-j-i H h qi-i ■ ■ ■ qi^(^d~i).jPi-(d-i)j-i 

= (1 - Q)pi-i + qi-i ■ ■ ■ q,^,j{pi^j^i + qi-j-i ■ ■ ■ qi-2jPi-2j-i 

H 1- qt-j-i ■ ■ ■ qi-d.m-dj-i)- 

Canceling like terms, this reduces to Pi-i = (1 — Q)pi-i + Qpi-i, which proves 
that TT, defined by (IT])-(|4]), is the stationary distribution for P. □ 

At equilibrium, what is the probability p° that, at a particular coup, the 
player wins the J-coin Futurity award by losing for the Jth (or 2 Jth or 3 Jth or 
. . . ) consecutive time? This happens if and only if the Markov chain is in state 
(i, J — 1) for some i £ {0, 1, ...,/— 1} just before the specified coup and that 
coup results in a loss. Using ((T|)-(I11), the probability is 

I-l I-l d 

P° ^Yl ^ = j(i _ Q) X! X! * ■ ■ ■ qi~kj+iPt-kj- (7) 
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Notice that the last of the d terms in the inner sum is Qpi. 
Therefore the mean payout, at equihbrium, is 



1 ^"^ 

:=y^M4 + Jp°. (8) 

1=0 



Incidentally, in the special case I = J (i.e., d = 1), ([7]) reduces to 



3 Strong law of large numbers 

Mean payout is the most important statistic of a slot machine. It can be in- 
terpreted as the long-term proportion of coins played that arc paid out to the 
player. The justification of this interpretation is the strong law of large num- 
bers, which is well known to hold for traditional machines, whose sequence of 
payouts is independent and identically distributed (i.i.d.). Does the same con- 
clusion hold for the Futurity, even though the independence assumption and the 
identically distributed assumption fail? 

We will show that the answer is affirmative. 

Let i?i , i?2 , . . . be the sequence of payouts of the slot machine excluding the 
Futurity awards, given that the initial state {Xo,Yq) — (io,ja) e S is speci- 
fied. This sequence clearly satisfies the strong law of large numbers. Indeed, 

i?2, ■ • ■ are independent nonnegative random variables, with {Rn+mi, w > 
0} identically distributed as the payout distribution in cam position i (which 
has mean ^i), where io + n—l = i (mod /). We conclude that, if n is a multiple 
of /, then 

1 

n~lE[i?i + ■■■+Rn]^J"^fi^=■.^l. 

i=0 

It follows from a version of the strong law of large numbers for independent, 
but not identically distributed, random variables that 

n~^{Ri + • • • + Rn) M a.s. 

Now, how does this change when the Futurity awards are taken into ac- 
count? Let Rl, R2, ■ ■ ■ be the sequence of payouts of the slot machine including 
the Futurity awards, given that the initial state {Xq,Yq) = {io,jo) € S is spec- 
ified. Notice that, for each n > 1, y„ is a nonrandom function of (Xq^Yq) and 
l{_Ri=o}7 • ■ • 7 l{i?,„=o}; in particular, Yn~i is independent of i?„. Clearly, 

-R* = Rn + J ■ l{y„_i = ,/-l, H„=0} 

/-I 

= i?„ + J ^ l{(X„_i,Y„_i) = (i,,/-l),fl„=0}j n > 1. 

4=0 
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It follows that 

7-1 

i \ - 

=0} 



Rl + ■ ■ ■ + R*^ Ri + ■ ■ ■ + Rn 1 v-^ 

2^- 2^^{{Xl-l,Y,.,) = i^J-l),Rl-- 



n n ^ — ' 71 

i=0 1=1 

7-1 



J TT{i, J — l)qi ^1-1 + Jp° ~ n* a.s. 



4=0 



where /x* is as m ([S]); here the hmit assertion requires additional justification. 
Since the Markov chain is finite, irreducible, and periodic. 



^ ^{{Xi-uY,^^)={i,j-i)} - 1) a.s. 

1=1 

for i = 0, 1, — 1, hence 
1 " 

-'Y^{(Xi^uYi-i) = {i,J^l),Ri=0} 



n 

1=1 



1 " 



„ ^ {(x,_i,y,_i)=(«,j-i)} 
1=1 



E/Li l{(Xi_i,yi_i)=(i,j-i),7?,=o} 



Yd=l l{(X,_i,Y,_i) = (i,J-l)} 

7r(i, J — l)qi a.s. (10) 



for i = 0,1, . . . , J — 1. We are using the fact that the ratio of sums in pi 
represents the proportion of visits to {i,J—l) (through time n — 1) that result 
in a Futurity award. At each visit to {i,J—l) the probability of such an award 
is Qi and the results are determined independently; hence the ratio tends to g, 
a.s. by the strong law of large numbers. 

We have established the following version of the strong law of large numbers: 

Theorem 2. Let R\, R^, . . . be the sequence of payouts of the generalized Futu- 
rity slot machine starting in an arbitrary initial state (Xq,Yq) = (io,jo). Then 

n-\Rl + ■ ■ ■ + R;J ^ fi* a.s. 

Observe that we can similarly obtain the asymptotic frequency of nonzero 
payouts, the so-called "hit frequency" (usually reported as a percentage): 

"~^(l{7?i>o} H \- 1{7?-.>0}) 

_ ^{Ri>o} + ^ l{7i;„>o} ^ l{yo=j-i, 7^1=0} + ^ l{y„_i=j-i,fl„=o} 

n n 

1 

1=0 
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4 Central limit theorem 



The second-most important statistic of a slot machine is the variance of the 
payout. (This is arguable. Some would say that the hit frequency p* is more 
important.) The variance permits determination of the asymptotic distribution 
of the cumulative number of coins paid out by the machine, via the central 
limit theorem. The central limit theorem is well known to hold for traditional 
machines, whose sequence of payouts is i.i.d. Does the same conclusion hold 
for the Futurity, even though the independence assumption and the identically 
distributed assumption fail? 

We will show in two steps that the answer is affirmative. First, we will 
apply the central limit theorem for stationary, strongly mixing sequences, and 
this will allow us to evaluate the variance parameter. Then, using a simple 
coupling argument, we will treat the general case in which the initial state is 
fixed but arbitrary. 

It will be convenient to index time by Z, the set of integers. So we let 
{-Rnjnez be independent nonnegative random variables, with {i?„ : n — 1 = i 
(mod J)} identically distributed as the payout distribution in cam position i € 
{0,1,...,/ — 1}. We interpret {i?,i}„gz as the sequence of payouts of the slot 
machine excluding the Futurity awards. Thus, 

P(i?„ > 0) ==p„_i, E[i?„] = ^„_i, Var(i?„) = cr^_j 

for all n € Z, provided we extend these parameters periodically; for example, 
Pi+mi '■= Pi for all i £ {0, 1, ...,/— 1} and m g Z. 

Notice that we can define the Markov chain {(X„, F,i)}riez as a nonrandom 
function of {i?„}nez- Indeed, X„ = i G {0, 1, ...,/— 1} \i n = i (mod /), so 
{X„}„gz is deterministic, and Yn = J G {0, 1, . . . , J — 1} if 

Rn-kj-3 > 0, Rn~kj-3+i = ' ' ' = i?„ = for somc fc > 0. 

To take the Futurity awards into account, we define {i?*}„gz by 

Rn Rn + J ■ l{Y„_i = J-l, i?„=0} 

oo 

= Rn + l{_R„_j^,>o,_R„_fcj + i= - =_R„_i=fl„=0} 

fc=l 

= u{...,Rn-2,Rn-l,Rn), n G Z. (12) 

for some nonrandom function u. 

The sequence {Rn}nez is independent but not identically distributed, so we 
consider the sequence of random vectors 

Rk (Rki+iT ■ ■ , R{k+i)i), fc e Z, 
which is i.i.d., hence by ([T2|) . 

-''^fe •= (-Rfc/+l) • • ■ ' R*k+l)l)^ fc € Z, 
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is a stationary sequence. In particular, the sequence 

Sk Rki+i + • • • + R{k+i)i, A: e Z, 
is also i.i.d., and the sequence 

^k R-ki+i + • • • + R{k+i)ii k e Z, 

is also stationary, despite the fact that the driving Markov chain {{Xn, Yn)}n&z 
is not stationary in this construction. Sk and S^. represent the total payout, 
excluding and including the Futurity awards, respectively, over the segment of 
/ consecutive coups numbered fc/ + 1, . . . , (fc + 1)/. 

We claim that the stationary sequence {S^jfegz is strongly mixing, that is, 
the quantities 

a{m):= sup |P(A n B) - P(A)P(B)| (13) 

AGcr(S*:fc<-m), Be(T(S*:fc>0) 

satisfy a(m) ^ as m ^ oo. For m > 2, let Cm '■= {Rk > for some 
k € {-(m - 1)/ + l,-(m- 1)1 + 2,.. . ,0}. Then, with A and B as in ([T3|, A 
is independent of B n C^, so 

\P{AnB)-P{A)P{B)\ 

< \P{A DBn c„0 - P{A)P{B n c„OI + |P(^ n B n - p{A)p{b n C'Jl 
= \P{AnBnC'„,)-P{A)PiBnc^J\ 

^ PIC"™) = P(i?_(„i_l)/+1 = R-{m~l)I+2 = ■ ■ ■ = Ro = 0) = Q™ ^, 

and this shows that a(m) converges to geometrically fast. 

Letting /2 := E[5q] and noting that the random variables of interest are 
uniformly bounded, the central limit theorem for stationary, strongly mixing 
sequences (e.g., Bradley 2007, Theorem 10.3) tells us that 



'S'o H h S^_i -mfi d 



iV(0,l), 



provided 

oo 

a' := Var(5*) + 2 ^ Cov(5*, 5,;) > 0. 

m— 1 

We now evaluate a^. 

First, we will frequently encounter 

p(r,_i = J - 1, i?, = 0) 

= PiR^~kJ > 0, =---=R,^Q) 

fc=l 

1 

= , _ ^ f?!-! ■ ■ ■ qt-kjPi-kJ-1 
^ ^ k=l 
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for i = 1,2,...,/. For example, 

I I 
= J2 E[K] = E + J ■ l{i-.-i=J-i, R.=o}] 

i=l 1=1 
/ /-I 7-1 

= Y.i^i^-l + JP.-i) = 51 + 

i=l i=0 i=0 

Next, for i = 1,2, . . . ,/, 

Var(/?*) Var(i?, + J • 1{y^_,^.j-i.r,=o}) 

= Var(/?,) + 2JCov(/?,, l{y,_i=,7-i, 7i,=o}) + J^Var(l{y_^=j_i, ^^^o}) 
= Var(i?0 - 2JE[i?,]P(K,_i = J - 1, i?, = 0) 

+ J2p(y,_i = J - 1, i?, = 0)(1 - P(i;_i = J - 1, i?, = 0)) 
= af i _ 2J//,_iP,_i + J2p,_i(l - 

and, for 1 < i < j < /, 

Cov(i?*,i?*) Cov(i?, + J- l{y._i=j-i,7?.=o},-Ri + ^- l{y,_i=j-i,7?,=o}) 

= JGoY{Ri,l{Yj-i = J-l.R,=0]) 

+ -'^^C!ov(l{y._j=j_i^^_=o}7 l{y,_i=j-i,7?3=o}) 
= J{E[i?, l{y^._, = j_i,H,=0}] - E[i?,]P(y,_i - J - 1, i?, = 0)} 
+ J2[p(y^_i = J - 1, = 0, Yj^i = J - 1, /?j = 0) 

- P(i;_i = J - 1, = 0)P(r,_i = J - 1, = 0)] 

= J ( E ■ ■ ' 1j-kJPj-kJ-l 

^l<k<{j-i)/J 

+ AijQj-i ■ ■ ■ Qi — Pj-1 

+ J^i E ij-i- --qj-kjpj-kj-iPi-i 
^i<k<{j~i}/j 

+ Ay E • • • qj-kJPj-kj~i - Pi-iPj-1 

k>u-i)/J 

where 1 if j — z = (mod J) and otherwise, and the infinite series 

in the definition of Aij can be expressed as the finite sum 

E ■ ' ' 1i-kJPj-kJ-i + QPj-l 

U-i)/J<k<d 
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when j — i = (mod J) . We conclude that 

Var(S'*) = Var(i?* + • • • + i?J ) = ^ Var(i?*) + 2 ^ ^ Cov(i?*, i?*) 

1=1 l<i<j<I 

7-1 

1=0 l<i<j</ 

Notice that this formula depends solely on the basic parameters (/, J, pi, fii^ 
and af). 

Next, for i, j = 1, 2, . . . , / and m > 1, 

= Cov(i?j + J • l{y._i=j-i,/?;=o}, Rmi+j + J ■ l{y,„i+j_i=,/-i,i?„7+j=o}) 
= JCov{R„ l{Y'„,+j_i=j-i._R,„f+^=o}) 

+ Cov(l{y^_j=j_i_fl.^o}7 l{y„7+,_i=j-i,fl„7+,=o})- 

Now 

Cov(i?i, l{Y„,^.^_i = J-l,_R„j+^-=o}) 

= ^ E[i?i l{;/j^^_^^^.>o,_R„j_^,^^^._i_i=...=ij„j+^.=0}] - Mi-l^'j-l 

l<fc<mrf+0"-i)/J 

= ^ Qj-l ■ ■ ■ qj-kjPj-kJ-lfJ-i-l 

l<k<md+{j-i)/J 

+ ^ij^ml+j-l ■ ■ ■ q-il^i-l — 

= ( ■ ■ ■ <ij-kJPj-kj-i{l + Q + --- + Q™ ^) 

^ fe=i 

+ Q""^ Y Qj-i ■ ■ ■ qj-kjpj~kj~i 

l<k<d+{j-i)/J 

+ AijQj^i ■ ■ ■ qoQ'"'~^qi-i ■■■qi - Pj-i 

= ( - Pj-l + X! '^■J-l ' ' ' 1j-kJPj-kJ-l 

^ l<k<d+{j-i)/J 



+ Ay • • • qiqj-1 ■■■qoj Q'" 

— ■ Q ' 

where qi-i ■ ■ ■ qi :~ I if i ~ I , and 

Cov{l^Yi^i = J-l,Ri=0}, l{y„/+j-i = ,/-l,_R„/+j=0}) 

= P(K,_i =J-1,R, = 0, Yrnl+j-l = J - 1, = 0) - P,-lPj-l 
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Pi-lP{RmI~k.J+j > 0, RmI-kJ+j+1 — • • • — Rml+j 

l<k<md+{j-i)/.J 

+ ^ ^(Rml-kJ+j > 0, RmI-kJ+j + 1 = ■ ■ ■ = Rml+j 

k>md+(j-i)/J 

- Pi-lP'j-l 

^ ■ ■ • qj-kJPj-kj-iPi-i 

l<k<md+{j-i)/.J 

+ ^i] "^J-l ■ ■ ■ Ql-kJPj-kJ-l - Pi-lPj~l 

k>md+{j-i)/.J 

d 

qj^i ■ ■ ■ qj^k.JPj-kJ-lil + Q + --- + Q"'-^)Pi-i 



k=l 

I — 1 



• • • Qj-kjPj-kJ-lPi-l 

l<k<d+{j-i)/J 

-AyQ""i E 9^-1 ■■•'7.-fe./P.-fe./-i- ^-1^-1 

k>d+{j—i)/J 

Pi-lPj-1 + Y • • • Qj-kJPj-kJ-lPi-l 

l<k<d+(3-i)/.J 

■ ■ ■ Qj-kjPj-kj-i Q'" 
fc>d+0-i)/j ^ 

and the infinite series in the definition of C,j can be expressed as 
Q Y ' ' ' Ij-kJPj-kJ-i + Q'^Pj-l 

U-i)/J<k<d 

when j — i = (mod J) and j > i, and as 

Y ^^-^ ' ■ ■ Ij-kJPj-kJ-i + QPj-l 

d+(]~i)/.J<k<d 

when j — i = (mod J) and j < i. We conclude that 

Cov{Sq,S*„) = Gov{Rl H h R*nl+1 H 1- ^("m+l)/) 

/ / / / 

= E E cov(K, = E E('^^'jQ'""' + -^'^'j^' 
i=i j=i i=i j=i 



and hence that 



J ^ ^ 



?n — 1 i— 1 j—1 
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Again, this formula depends solely on the basic parameters. Summing (|14p and 
twice ([15]), we obtain . 

Finally, we observe that the central limit theorem for the stationary sequence 
{S^jfegz yields a central limit theorem for {R*i}nez as well. Indeed, with 

H*^fl/I and (cr*)2 aV/, 

we find that 

tends to a.s. as n — > oo because the difference between the numerators, namely 

R\n/i\+i + --- + Rn-{n- Iln/I\)^i*, 
is uniformly bounded in n and the denominators are equal. Thus, 
Rl + ---+R*„-nn* d 



iV(0,l). 



We can go one step further and derive a central limit theorem for {R^}„>o 
with (Xq, Yq) = (io, jo) specified, where the hats on i?* , Xq, and Yq distinguishes 
them from the i?* , Xq, and Yq already defined. The idea of the proof is the 
same as in p6|) . We define Rn ■= Rn+ia for n > 1, and we define (X„,y„) for 
n > 1 in terms of {Xq, Yq) = (ioj jo) and Ij-^^^^Qj, ■ . ■ , 1^^ in the usual way. 
Then 

RI + --- + RI- nn* _ RI + --- + RI- n/x* 

tends to a.s. as n — > oo because -R* — Rn+i^ unless Rl ~ ■ ■ ■ — R^_i = 0. 
In words, the sequences Rl, . . . , i?* and Rl, . . . , i?* differ only by a shift (of zo 
terms), once the Y process and the shifted Y process couple, which occurs after 
the first win. We have therefore established the following central limit theorem: 

Theorem 3. Let Rl, R2, . . . be the sequence of payouts of the generalized Futu- 
rity slot machine starting in an arbitrary initial state. Then 



5 Numerical results for the Futurity 

The Futurity was in production from 1936 to 1941. (After Dec. 7, 1941, Mills 
Novelty stopped producing slot machines and became a defense contractor for 
the duration of the war. When it resumed slot production in 1945, it did so 
with new designs.) In particular, there were minor variations in the payouts 
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and reel strip labels used with the machine, but the fundamental properties, 
the Futurity award and the periodic mode changes, are common to every Mills 
Futurity. The precise version we consider here is the one described by Geddes 
(1980). 

To simplify matters, wc code the six symbols as lemon = 0, cherry = 1, 
orange ~ 2, plum = 3, bell = 4, and bar = 5. The pay table can then be 
described by the function p : {0,1,2,3,4,5}'^ i-^ Z+ given by p(5,5,5) := 150, 
p(4, 4, 4) = p(4, 4, 5) := 18, p(3, 3, 3) = p(3, 3, 5) := 14, p(2, 2, 2) = p{2, 2, 5) := 
10, p(l, 1, 0) = p{l, 1, 4) := 5, and p(l, 1, 2) = p{l, 1, 3) = p{l, 1, 5) := 3; oth- 
erwise p := 0. The three reel strips can be described as follows, in which the 
symbols in odd-numbered positions are italicized for convenience: 

reel 1 : i, 5, 1, 2, 1, 5, 1, 5, 1, 3, 1, 2, 5, 1, 4, 3, 1, 5, 1, 2, 
reel 2:1,4, A 3, i, 4, 1, 2, 1, 4, 1, 4, 1, 2, 1, 2, ^, 1, 5, 4, 
reel 3 : 5, 4, ^, 0, 3, 4, ^, 0, 1 0, ^, 3, ^, 4, ^, 4, 5, 2, 3, 5. 

Table [1] summarizes the relevant information from these reel strips. Of course, 
the reels operate independently, and the 10 possible positions at which each reel 
can stop (given the mode) are assumed equally likely. 



Table 1: Reel strip inventories for the Futurity in both modes. 



mode E mode O 



symbol 


reel 1 


reel 2 


reel 3 


reel 1 


reel 2 


reel 3 


lemon (=0) 








3 











cherry (=1) 


1 


1 





8 


8 





orange (=2) 


3 


3 


1 








5 


plum (= 3) 


2 


1 


1 








3 


bell (= 4) 





5 


4 


1 


1 


1 


bar (= 5) 


4 





1 


1 


1 


1 


total 


10 


10 


10 


10 


10 


10 



With f^Eihi) denoting the frequency of symbol i on reel j in mode E (see 
Table [ij, we find that the mean payout in mode E is 

^ 5 5 5 

ME = X! X! X! •^e(«i, 1)/E(«2,2)/E(i3, 3)p(ii, 12,^3) = 0.28. 

^ ' 21=012=013=0 

Similarly, the mean payout in mode O is /io — 2.234. Certainly, these numbers 
justify our descriptions of mode E as "tight" and mode O as "loose," as do 
the facts that the probability of a nonzero payout in mode E, other than a 
Futurity award, is pE ~ 0.032. and the corresponding probability in mode O is 
po = 0.643. See Table El 
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Table 2: Payout frequencies and statistics for the Futurity in both modes, ex- 
cluding Futurity awards. Results are exact (no rounding). 



payout 


mode E 


mode O 





968 


357 


3 


3 


576 


5 


7 


64 


10 


18 





14 


4 





18 





2 


150 





1 


total 


1,000 


1,000 



mean payout 
variance of payout 
probability of nonzero payout 



= 0.28 = 2.234 

o-| = 2.7076 al = 24.941244 
PE = 0.032 po = 0.643 



With the statistics of Table [21 we can define 

{Po,Pi, ■■■,P9) := {pe,Pe,Pe,Pe,Pe,Po,Pe,Pk,Pe,Po), 
(mo, Ml: ■ • ■ j Mg) := (me, Me, Me, Me, Me, Mo, Me, Me, Me, Mo), 

/ 2 2 2\ /222222 2222\ 

(cro,CTi . . . ,(Tg) := {a^,a^,a^,a^,a^,(TQ,a^,a^,a^,ao), 

and Qi := 1 — pi for i = 0, 1, . . . , 9. With / = J = 10 (in particular, d = 1), 
we can apply Theorem 1 to obtain the stationary distribution for the driving 
Markov chain. Numerical values are shown in Tabled Geddes and Saul (1980) 
obtained an approximate stationary distribution from their simulation, essen- 
tially accurate to three decimal places. One drawback of a simulation in this 
context is that it does not clearly show that, when the stationary distribution 
is expressed as a matrix, several entries in each column are equal. 
We calculate from dH), ©, and (HI]) that 

p° w 0.0168011, fi* w 0.838811, p* w 0.171001. 

Based on their simulation of 1,000,000 coups, Geddes and Saul (1980) obtained 
the estimates 0.016638, 0.838995, and 0.171451, respectively. They did not 
attempt to estimate the variance parameter. Using ([Ti]) and p^ . we find that 

oo 

Var(S'o) « 69.860263, ^ Cov(S'o, S",;,) « -0.951088, 

?n — 1 

hence 

(cr*)2 sa 6.795809. 
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Table 3: Stationary distribution of the Markov chain, rounded to six decimal 
places. Rows indicate cam position, and columns indicate pointer position. 
Entries greater than 1/100 are shaded. 





G 


1 


2 


3 


4 




6 


7 


8 


9 







.071306 


.001267 


.001226 


.001187 


.023090 


.000410 


.000397 


.000384 


.000372 


.000360 


1/10 


1 


.003649 


.069024 


.001226 


.001187 


.001149 


.022351 


.000397 


.000384 


.000372 


.000360 


1/10 


2 


.003549 


.003435 


.066815 


.001187 


.001149 


.001112 


.021636 


.000384 


.000372 


.000360 


1/10 


3 


.003549 


.003435 


.003325 


.064677 


.001149 


.001112 


.001077 


.020943 


.000372 


.000360 


1/10 


4 


.003549 


.003435 


.003325 


.003219 


.062608 


.001112 


.001077 


.001042 


.020273 


.000360 


1/10 


5 


.003549 


.003435 


.003325 


.003219 


.003116 


.060604 


.001077 


.001042 


.001009 


.019624 


1/10 


6 


.071306 


.001267 


.001226 


.001187 


.001149 


.001112 


.021636 


.000384 


.000372 


.000360 


1/10 


7 


.003549 


.069024 


.001226 


.001187 


.001149 


.001112 


.001077 


.020943 


.000372 


.000360 


1/10 


8 


.003549 


.003435 


.066815 


.001187 


.001149 


.001112 


.001077 


.001042 


.020273 


.000360 


1/10 


9 


.003549 


.003435 


.003325 


.064677 


.001149 


.001112 


.001077 


.001042 


.001009 


.019624 


1/10 




.171001 


.161193 


.151837 


.142915 


.096857 


.091152 


.050526 


.047593 


.044797 


.042130 





All displayed numbers are exact except for rounding. 

Geddes and Saul (1980) also proposed a very interesting betting strategy: 
Simply play the machine until, and only until, a payout occurs. Let E[i,j) 
be the player's expected profit when starting from cam position i and pointer 
position j. Then 

E{i,Q) = -1 + /.*, + lOg,, i = 0,1,. ..,9, 

where of course the 10 is the Futurity award. Furthermore, 

E{i,j) = -1 + ^Li + qiE{i + 1 (mod 10),i + 1), i = 0,1,.. .,9, 

for J = 8, 7, . . . , (in that order). These expectations are evaluated numerically 
in Table m This result is due to Geddes and Saul. 

Table 4: Expected player profit when playing until a payout occurs, as a function 
of initial cam position (row) and pointer position (column), rounded to six 
decimal places; columns 8 and 9 are exact. 



-1.640567 
-1.056559 
-.453244 
.170015 
.813877 
1.479024 
- .743671 
-.130013 
.503931 
1.158832 



-.210554 
-.950999 
-.347685 

.275574 

.919437 
1.584584 

.686343 
-.024453 

.609491 
1.264392 



.085131 

.526288 
-.238636 

.384623 
1.028486 
1.693633 

.982028 
1.452834 

.718540 
1.373441 



.390591 
.831747 
1.287487 
.497277 
1.141140 
1.806287 
1.287487 
1.758293 
2.244663 
1.486095 



.706148 
1.147305 
1.603045 
2.073850 
1.257518 
1.922665 
1.603045 
2.073850 
2.560220 
3.062668 



5.122320 
1.473294 
1.929034 
2.399839 
2.886209 
2.042890 
1.929034 
2.399839 
2.886209 
3.388657 



6.035454 
6.035454 
2.265799 
2.736605 
3.222975 
3.725423 
2.265799 
2.736605 
3.222975 
3.725423 



6.978775 
6.978775 
6.978775 
3.084503 
3.570873 
4.073321 
6.978775 
3.084503 
3.570873 
4.073321 



7.953280 
7.953280 
7.953280 
7.953280 
3.930272 
4.432720 
7.953280 
7.953280 
3.930272 
4.432720 



8.960 
8.960 
8.960 
8.960 
8.960 
4.804 
8.960 
8.960 
8.960 
4.804 



We find that, if the pointer position is 3-9, a positive expectation is assured 
(regardless of the cam position). In fact, 90 of the 100 expectations are positive. 
Perhaps more surprising is the fact that 



^ ^{i.j)E{i,j) 



0.960501. 



17 



In other words, the "stop after the next payout" betting system has positive 
expectation when played at equiUbrium. This observation, however, is less useful 
than it may first appear to be. For if the player has reached approximate 
equilibrium through extensive play, then the positive expected profit the system 
promises will not make up for the negative expected profit already incurred. And 
the player should not expect to find a machine at approximate equilibrium after 
extensive play by others. Indeed, a player quits not at a fixed time, such as after 
the 10,000th coup, but rather at a random stopping time, such as after the next 
win, or after running out of coins. Moreover, as we have seen, if the pointer 
position is 3-9, a player has positive equity and may not want to relinquish it 
by walking away. It seems likely that most players would notice this at least for 
pointer positions 7, 8, and 9, for in those cases a loss is impossible. 

Geddes and Saul (1980) remarked that "the machine tends to leave the player 
at an unprofitable starting point most of the time after paying off." One way 
to confirm this is to evaluate the asymptotic distribution of the Markov chain's 
state after a payout. Arguing as in pT|) . we get 

,. J2?=i^{R-!>o,iXi,Yi)H'hO)} 
hm — 

1^1=1 l{i?,*>o} 

^ (!/"-) I]Li(l{x,_i=i-i,fl,>o} + l{(Xi_i,yi_i)=(»-i.9),fl,=o}) 

(l/»)ELl(l{fli>0} + l{y,_i=9,fl,=0}) 
{0.1)pi^l+7T{i-l,9)qi-i 



(0.8)pE + (0.2)po+P° 



=: p{i, 0) a.s.. 



where p_i := pg, etc. We find that p{0,0) = p(6, 0) « 0.416991 and p{i,0) « 
0.020752 otherwise, and of course states (0, 0) and (6, 0) have negative entries 
in Table [H Geddes and Saul obtained approximations from their simulation. 
Observe that states (0, 0) and (6, 0) account for about 0.833982 of the probabil- 
ity, which can be interpreted as the long-term proportion of payouts that occur 
when the machine is in mode O. This is the same as the long-term proportion 
of Futurity awards that occur when the machine is in mode O. 

Finally, we observe that the previous mode (E or O) is clear at a glance. 
This depends on the fact that the machine's payout window displays not only 
the three symbols on the payline (from the last coup) but also the symbols on 
the line above and the line below the payline. If the previous mode was O, then 
exactly four coups are needed to determine the cam position with certainty; if 
the previous mode was E, then at least four and at most seven coups are needed. 
The player who is unwilling to play without a positive expectation should play 
with pointer position 3 or greater, but also pointer position 2 if the previous 
mode was O. 



6 A two-armed slot machine 

Motivated by Parrondo's paradox, here we consider a two-armed generalization 
of the Futurity slot machine, and we label the arms A and B. Excluding the 
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Futurity award, the sequence of payouts from each arm is assumed nonnegative 
i.i.d., with arm A (resp., B) having probabihty pA (resp., pb) of a nonzero 
payout and mean payout ^j,a (resp., ^b) in all cam positions. The two arms are 
linked only by the Futurity award: After J consecutive losses, regardless of the 
order of play of the two arms, the J lost coins are returned to the player. We 
assume that J > 2, and we let 1 — pA and qs 1 — Pb- 

The asymptotic mean payout per coup, including the Futurity award, from 
playing arm A only (resp., arm B only) is 

fiA = tJ-A + JPA, where Pa ■= j 

(resp., ^ ^B + Jp°B, where p°g := pBqs/il - qs))- If wc play arm A 
with probability 7 (0 < 7 < 1) and arm B otherwise, a strategy we denote 
by C :~ ^A + (1 — 7)S, then this random mixture has probability pc 
JPA + (1 — i)pb of a nonzero payout and mean payout /ic J^J■A + (1 — i)i^b 
in all cam positions, excluding the Futurity award. Let qc := 1 —pc- Then the 
asymptotic mean payout per coup, including the Futurity award, from playing 
the random-mixture strategy with parameter 7 is 

/^c — + JPc^ where Pc ■= j- 

^ ~ 1c 

We will say that the Parrondo effect is present for the random-mixture 
strategy with parameter 7 if 

< 7/4 + (1 - 7)/^B- 

In words, the asymptotic mean payout per coup from playing the random- 
mixture strategy on the two-armed machine is less than the asymptotic mean 
payout per coup from playing the same random-mixture strategy on two one- 
armed machines, one of them equivalent to arm A and the other equivalent to 
arm each with its own Futurity award. 

Theorem 4. If pa 7^ Pb, J > '2,, and < 7 < 1, then the Parrondo effect is 
present for the random-mixture strategy with parameter 7. 

Remark. As Abbott (2009) remarked, "In its most general form, Parrondo's 
paradox can occur where there is a nonlinear interaction of random behavior 
with an asymmetry." Here J > 2 ensures the nonlinearity, while pA ^ Pb 
ensures the asymmetry. 

In the scenario of Pyke (2003) described in Section 1, p'^ = fig = 1 (both 
arms are fair), hence fi^ < 1 (the random mixture-strategy is losing for the 
player, hence winning for the casino). 

Proof. The function f{x) := (1 — x)x'-' /{I — x"^) is strictly convex on (0, 1) for 
each J > 2 because 

. _ Jx-'-'[J{l - x){l + x') - (1 + x){l - X-')] 

^ ^ (1 - X'')3 
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Therefore, 



> 0, 0<x<l. 

- [7Ma + (1 - l)fJ-*B] 

= J{ph-bPA + i^-l)PB]} 

= JifiiqA + (1 - 7)te) - [7/(9a) + (1 - 7)/(te)]} 
< 

since ^ qb and < 7 < 1. □ 
In fact, the function / of the proof satisfies 

1 - X + J fix) = (1 - X) = ^ ■ , < 1 

for < X < 1. In particular, pA + Jp°A < 1 and ps + Jp°B < 1- If we assume 
nonnegative integer payouts, then ^la > Pa and > Pb- It foUows that 
and /is can be chosen in such a way that pl\ = = 1. Actually, fractional 
payouts per unit bet are commonplace on modern slot machines. (For example, 
a machine with five paylincs might return three coins from a five-coin bet.) In 
such cases, a loss, for the purpose of the Futurity award, means a zero payout, 
not just a payout that is less than the amount bet. 

Now we turn to strategies involving nonrandom patterns of the two arms. 
Let D denote a (finite) nonrandom pattern of As and Bs, with at least one A 
and at least one B, that is repeated ad infinitum. For example, D could be 
as simple as AB or ABB, or it could be more complicated, such as ABBAB. 
Let r > 1 and s > 1 be the numbers of As and Bs, respectively, in pattern D. 
Then the asymptotic mean payout per coup, including the Futurity award, from 
playing pattern D repeatedly is given by ([8|) with / equal to the least common 
multiple of r + s and J. More precisely, 

IJ-D ■= : + JPd^ 

r + s 

where pj^ can be inferred from The simplest case is that in which r + s 
divides J because then (jH]) applies and we have 

_ rpA + spB f igM'^^''^'^ \ 

In this case (and hence fi*jj) depends on D only through r and s. For example, 
Paabbb ~ P°ABBAB ^OTig as J is a multiple of 5. 

We will say that the Parrondo effect is present for the nonrandom-pattern 
strategy with pattern D (with r As and s Bs) if 

< \ ■ 
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The interpretation is analogous to that of the random-mixture strategy. 



Theorem 5. If pa 7^ Pb, ^ > 2, and r, s > 1, and if r + s divides J, then the 
Parrondo effect is present for the nonrandom-pattern strategy with pattern D. 

Remark. While J is a characteristic of the machine, the pattern D (and hence 
r and s) is chosen by the player, so the assumption that r + s divides J is too 
restrictive. We believe that this assumption can be weakened considerably (see 
below), but it cannot simply be omitted. 

Proof. The presence of the Parrondo effect is equivalent to 

o . rp\ + sp% 

Pd ; ■ 

r + s 

By the arithmetic mean-geometric mean inequality and qA 7^ 95, 

\-iA-iBJ 

Since the function g{x) := .t'^/(1 — x"') is increasing on (0, 1), we have 

, ^rpA + SPB ( {q\q%Y'^'-+'^ 
Pd - 



< 



r + s VI - (9a9b)"'/^''+"^ 
rpA + spsf [{rqA + sqB)/ir + s)y 



PC < 



r-fs \l - [{rqA + sqs) / (r + s)Y 
rp\ + spl 



r 



where is as in the proof of Theorem 4 with 7 := r/(r + s), and the second 
inequality uses Theorem 4. □ 

Various attempts have been made at explaining why Parrondo's paradox 
holds in the nonrandom-pattern case; see, for example, Ethier and Lee (2009). 
When the assumptions of Theorem 5 are met, we have an especially simple 
explanation: the AM-GM inequality and convexity. 

Let us generalize (|17p to arbitrary D, r, s, and J. Although we can minimize 
the number of terms by taking / to be the least common multiple of ?- + s and 
J, we can equally well take / to be any multiple of r -I- s and J, and the simplest 
choice is I := (r + s)J (i.e., d :— r + s). Define each of pi,P2, ■ ■ ■ ,Pr+s to be pA 
or Pb in accordance with the corresponding term in the pattern D. Extend this 
definition by pi+r+s ~ Pi for all i G {1, 2, . . . ,r + s}, and define := 1 — pi for 
i = 1,2, . . . , 2(r -I- s). With this notation, we can write 

r+s , r+s ]+kJ-(,r+s)lkJ/ir+s)i \ / r „s MfcJ/(r+s)J 
k=l ^3 = 1 i=3 + l ^ y'iA'iBJ 



21 



where empty products are 1. For example, if r + s divides J, then all products 
are empty and this reduces algebraically to (|17p . For a less trivial example, 
consider D = ABB. Then, if J = 3/v + 1 for a positive integer K, 

Pabb (l/3)[(pAgB +PBqB + PBqA){qAq%)^ 

+ {PAqB +PBqBqA + PBqAqB){qAqBf'^ 

+ [pA + 2pB){qAqlY]/[l - [qAqlY], 
and, if J = 'iK + 2 for a nonncgativc integer K , 

Pabb = (i/3)[(pAg| + PBqBqA + PBqAqB){qAql)'^ 
+ [pAqB +PBqB + PBqA)iqAqBY^^^ 

+ {pA + 2pB){qAqiy]/[l - {qAqlV]- 

Despite the impression that may be given by the proof of Theorem 5, it is 
not true in general that < when 7 :~ r/{r + s), and it is easy to find 
counterexamples. It is also not true in general that depends on D only 
through r and s. For example, with J = 6, p\abb > Pabab = Pab PA Pb- 
However, extensive numerical computation suggests the following. 

Conjecture. Under the assumptions of Theorem 5, the conclusion holds for 
patterns of the form D B'^ if we replace the assumption that r + s divides 

J by any one of the following four assumptions: 

(a) J = 2. 

(b) min(r, s) = 1. 
{c) r + s< J. 

(d) PA+PB> 1/3. 

We can confirm the sufficiency of condition (b) at least in the simplest case, 
r = s = 1. The case of even J is covered by Theorem 5, so we suppose that J 
is odd, say J = 2K + 1 for some positive integer K. Then, by algebra, 

1,0, OA [PAqB +PBqA){qAqB)'^ + {PA+PB){qAqBY 

Pab - niPA ' - ^ - 



2^"^^^^ 2[1 ^[qAqBy] 

1 f PAq'A , PBqi 



2\1 -qi l-qi 

KqA,qB) 



2{l^qi){l-qJ,)[l-{qAqBY] 



where 



h{x, y) := [x^+i - y^+i + - y^)] 

■ [x^{l x){l y^^+i) - y^{l y){l x^^+i)] 
= (1 - x){l - - y'<+^ + {xyY'+\x'' - y^)] 
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K-1 

E( 

k=0 



K-k „,K-k 



> 0, x,ye (0,1), x^y. 

We conclude this section by asking, at what rate can the casino make money 
with our two-armed machine, assuming that both arms are fair in the sense that 
/Li^ = = 1? For simplicity, we suppose the player adopts the random- mixture 
strategy with 7=5- Then the casino's win rate is 



J 



iP°A+P°B) -Pc 



2 

= J 



1 f paQa , PBgi 



2 V 1 



[{pA+PB)/2][{qA + qB)/2y 
l-[iqA + qB)/2y 



(18) 



which for fixed J > 2 has suprcmum ^ [1 — J 2~-^/(l — 2""^)] , achieved as — *■ 
and pb — >■ 1 (and vice versa). But this case is unrealistic. 

Kilby, Fox, and Lucas (2005, p. 137) reported a simulation study of the effect 
of hit frequency on player longevity. They considered 10 slot machines with 
hit frequencies ranging from 6.7% to 29.6% and mean payouts being roughly 
equal. So we take pa = 3/10 and pB = 1/15 as being the extremes among 
hit frequencies considered typical in the industry (for single-payline machines). 
Notice that condition (d) of the conjecture is met. We find that (fT8|) is increasing 
in J for J < 20 and decreasing in J for J > 20. At J = 20 its value is about 
0.161553 (i.e., 16.2%), while at J = 10 its value is about 0.100383. Similar 
calculations can be done for other strategies. It would seem from the numerical 
evidence that there is a reasonable profit potential (for the casino) in a two- 
armed version of the Futurity with both arms fair and J ~ 10. However, it must 
be recognized that there are strategies other than those ordinarily associated 
with Parrondo's paradox, so our tentative conclusion about the viability of this 
machine on the casino floor is premature. 

Consider a strategy for which the choice of arm depends on the Futurity 
pointer. Specifically, let K and L be positive integers such that K + L = J, 
and assume that, if the Futurity pointer shows j consecutive losses and < j ^ 
K — 1, then arm A is pulled, otherwise arm B is pulled. The driving Markov 
chain has state space Si {0, 1, . . . , J — 1} and one-step transition matrix Pi 
defined by 



PA if < i < K - 1 and j = 0, 

qA if < i < A' - 1 and j ^ i + 1, 

Pb if K < i < J — 2 and j ~ 0, 

qB if K < i < J — 2 and j ^ i + 1, 

1 if i = J — 1 and j = 0. 



This chain is irreducible and aperiodic, and its unique stationary distribution 
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TTi is given by 

71"! (j) 

where 



c^'^lViT'^ if/^<.?<J-l, 



c:=l + qA + --- +qA + (1 + to + ' ' ' + )• 
If the mean payouts of arms A and B are 

1 = Ma = MA + and 1 = = + Jp°B, 

then the mean payout at equihbrium under our strategy is 

M* = f X! ^lO) jA'A + f ^ TTi (j)j/XB + Jtti{J - l)qB 

^ i=0 ^ ^ j=K ^ 

and we find that the Parrondo effect (in favor of the casino) holds if and only if 

Now if we substitute the formula for the stationary distribution, the constant c 
is irrelevant, and the condition becomes 

<?Afe < (1 + H \-qA )z j + + ^(1b )-, T 

or 

9a 9b < — : J 1 : J ■ 

1 - 9a 1 - 9b 

This is equivalent to 

K f^-lA 1 - 9b 



VI -9i i-9^y 

which holds if and only if qA > qB or equivalently pA < Pb- Here we are using 
the fact that the function fi{x) :— (1 — a;^)/(l — x^^) is decreasing on (0,1), 
which follows from 

Ja;'^-i(l - x^) - Lx^-^{1 - x'') 
^ {l-xJf 



fc=i ;=i 
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<o, 



< X < 1. 



So we have the Parrondo effect if < pb- If, however, pj^ > pg, then the 
Parrondo effect fails and the player has the advantage. 

Returning to our example in which pA — 3/10 and ps ~ 1/15, we suppose 
that J = 10 and consider the above strategy with K = 4. If /i^ = = 1, then 
we find that the player's win rate is about 0.145747 (i.e., 14.6%). We conclude 
that our machine is not ready for casino play. 

Figure 1 compares several strategies in terms of the casino's expected cumu- 
lative profit. 




number of coups 



Figure 1: Expected cumulative casino profit for various player strategies. We 
assume a two-armed slot machine with hit frequencies pA = 3/10 andps = 1/15; 
Futurity award paid after J = 10 consecutive losses, regardless of the order of 
play of the two arms; initial pointer position 0; and both arms fair when played 
exclusively = fig = 1). j is the Futurity pointer position. Results are by 
direct calculation (not simulation). 

The fact that the player can achieve a substantial advantage by using the 
information available from the Futurity pointer will not come as a surprise 
to those familiar with the original capital-dependent Parrondo games (Harmer 
and Abbott 2002). Let us recall the assumptions: In game A the player tosses 
a 1/2-coin (heads has probability 1/2), whereas in game J5, the player tosses a 
1/10-coin if his capital is divisible by 3, and a 3/4-coin otherwise. In both games, 
the player wins one unit with heads and loses one unit with tails. If the player 
can use information about his current capital to choose which game to play, the 
optimal strategy is clear: Play game A when capital is divisible by 3 and game 
B otherwise. Most studies of Parrondo's paradox disregard this strategy and 
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consider only "blind" strategies, those that do not rely on the player's current 
status. In the casino setting, however, one cannot expect a player to disregard 
information that may prove to be profitable. 
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